Method 1 - Babbitt Score 



(1100) For a given variable, for all 
observations, convert provided values 
into proxy values, if necessary. 




r 


(1200) For a given variable, for alt 
observations, segregate proxy values 

associated with the variable into 
categories (e.g., Top 2 box, Top 3 box, 
etc.) 




r 


(1300) For each category, determine 
values' distribution by dividing number 
of provided values in category by total 
number of provided values 




r 


(1400) Calculate a top category score 
by adding the top category distribution 
(%) to the bottom category distribution 
(%) and subtracting an ideal 
distribution of neutrals (%} and 
multiplying an absolute value of the 
result by 100 




r 


(1500) Calculate a difference score by 
subtracting the bottom category 

distribution (%) from the top category 
distribution {%) and multiplying an 
absolute value of the result by 100 


i 


r 


(1600) Calculate an effectiveness 
(Babbitt) score for the variable by 
adding the top category score to the 
difference score 


i 


r 



(1700) Evaluate the variable based on 
the effectiveness score 



Method 2 - Bestfit Clustering 



(21 00) For each observation, obtain dataset, 
each dataset having observation IDs, variables, 
possible values, provided values, and (where 
applicable) proxy values for provided values 



(2200) Specify a number of clusters, 
any desired variable weights, and a 
maximum number of iterations for the 
clustering solution 



! The # of clusters is an integer > 0. 
| The # of iterations is an integer > 0. 



(2300) Develop initial cluster 
assignments: Select only 1 path within 
(2130) 



(2350) Read specified initial cluster 
assignments (already present in 
dataset, cf. Method 3) 



Throughout Method 2, variable 
weights (where applicable) are 
incoroporated within fitness score 
calculation (cf. Method 10) 



(2360) Systematic Search: Identify 
the pair of variables that creates a 
clustenng solution that maximizes 
fitness score using the specified 
number of clusters 



(2370) Thorough Search: Identify any 
two variables that together create a 
clustering solution that maximizes 
fitness score using the specified 
number of clusters 



(2361) Discover the 1 variable that 
creates a clustering solution that 
maximizes fitness score using the 
specified # of clusters 



(2371) Discover the 1 variable that 
creates a clustering solution that 
maximizes fitness score using the 
specified # of clusters 



(2362) Hold the variable from (2361) 
constant and discover the variable that 
in tandem creates a clustering solution 
that maximizes fitness score using the 
specified # of clusters 



(2372) Hold variable from (2371) or 
(2373) constant and discover the 
variable that in tandem creates a 
clustering solution that maximizes 

fitness score using the specified # of 
clusters 



(2373) Hold variable from (2372) 
constant and find the variable that in 
tandem creates a clustering solution 
that maximizes fitness score 



(2400) Store observation IDs, corresponding 
duster IDs, fitness score 




To Fig. 2b 



Repeat this process by 

cycling through all 
possible combinations 
of variable pairings until 

fitness score as 
calculated in (2373) is 
maximized 



Fig. 2a 



Method 2 - Bestfit Clustering - Continued 



FROM (2400) 



(2450) For each cluster and variable, 
calculate the mode of provided values, 
and (where applicable) proxy values 
for provided values 



(2460) Store cluster IDs, variable IDs, 
and corresponding modes from (2450) 



From (2591) 



(2470) Select a fraction of 
observations, divided evenly among al! 
specified clusters from the dataset 



(2480) Randomly re-assign the 
observations from (2470) to different 
dusters 



It is preferrable that 
observations be chosen 
randomly; furthermore it is 
preferrable that the exact 
fraction never exceed 10% of 
the entire dataset's population 
of observations 



(2490) For each cluster and variable, 

calculate the mode of provided 
values, and (where applicable) proxy 
values for provided values 



(2500) Calculate fitness score for the 
clustenng solution developed in (2480) 



(2505) Store fitness score, cluster 
assignments, and observation IDs 



From (2550) 



(2510) Select one random observation 
from a random cluster and change its 
cluster assignment 

* 



(2520) Calculate fitness score of 
(2510) 



(2530) Conditional function: Compare 
fitness score of (2520) with (2505) 



Only proceed if looping 
from (2550) 



(2531) If fitness score of (2520) 
< or = fitness score of (2505), 
cycle through ail possible cluster assignments 
for observation selected in (2510) until fitness 
is maximized 



(2536) If fitness 
score of (2520) 
> (2505), proceed 
to (2540) 



(2532) Conditional function: Compare 
maximum fitness score of (2531 ) with (2505) 



(2533) If fitness score of (2520) 
<or= (2505), return selected 
observation to original cluster 
assignment 



(2535) If fitness 
score of (2520) 
> (2505), proceed 
to (2540) 



Hold the other observations in I 
their current cluster j 
| assignments from (2505) 



(2551) If fitness score of 
(2520) = (2505), 
proceed to (2560) 



(2552) If fitness score of 
(2520) < or > (2505), 
return to (2540) 



(2534) Return to 
(2510) 



(2540) Store 
Observation IDs 
and new cluster 

assignments 



(2550) Replace 
(2505) with (2540) 
and return to (2510) 



Fig. 2b 



Method 2 - Bestfit Clustering - Continued 




FROM (2551) 



To (2470) 



(2560) End Iteration 



! Steps (2510) j 
| through (2560) j 
i represent 1 Iteration ] 



(2570) Store Iteration ID, 
Observation IDs, corresponding 
cluster assignments 



Iteration ID is a positive integer <= the 
total # of specified iterations. Its value 

increases serially in the form 
x + 1 where x = previous iteration ID. 



(2580) Conditional function: 
compare iteration ID from 
(2570) with total # of iterations 
specified in (2200) 



(2581) If Iteration 
ID from (2580) < 
total # of iterations 
specified in (2200), 
return to (2470) 



(2582) if Iteration 
ID from (2580) = 
total # of iterations 
specified in (2200), 
proceed to (2600) 



(2600) Store Iteration ID that produced maximum 
fitness score, maximum fitness score, observation 
IDs, and corresponding cluster assignments that 
produced maximum fitness score 



(2610) Dump data from (2600) 
into a file of usable format (e.g. 
ASCII, .csv, .bet, .pm) 



I 

(2620) Terminate 
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Method 3 - Champion/Challenger 
Clustering Refinement 



(3010) For each observation, obtain dataset, 
dataset having variables, possible values, 
provided values, and (where applicable) 
proxy values for provided values 






(3020) Append initial cluster assignments 
to dataset (so they correspond to 
Observation IDs) 




r 


(3030) Specify maximum number of 
iterations 




r 


(3040) Execute (2450) to (2610) of 
Method 2 




ir 


(3050) Terminate 



Fig. 3 



Method 4 - Composition Analysis 



(4010) For each observation, obtain dataset 
having a cluster assignment for the 
observation and having a proxy value for 
each of the vanables in the dataset, each 
variable having possible values 



(4020) For each observation, estimate a 
purposeful probability (a measure of a 
proability that an observation in a particular 
duster provides an answer to a question in 
a non-random manner) that a particular 
possible value for a particular variable will 
be provided by observations assigned to a 
particular cluster 



(4021) Create probability vanables 
for each cluster, variable, answer 
combinatio ns as p ^ ^ 



(4022) Estimate the probability that answer 
valued is given by the observations m 
cluster m for a variable k that has L k 
possible answers 



If 8 - 0, the resulting 
over-precision of the 

calculated probabilities 
compromises 

computational efficiency 



(4023) Define 8 within a constraint that 
allows for usable output 



(4025) For each observation, 
store and/or output the 
purposeful probability 



(4024) Computational process is executed 
across all 



(4030) For each observation and 
each possible value, calculate a 
serendipity probability (a measure 
of a probability that an observation 
in a particular cluster will be 
associated with any of the 
possible values for a particular 
variable) 



If a observation i in cluster m 
selected responses 
"randomly," then the 

probabilities of selecting his 
responses should be 
described as 

L 



(4050) For each observation, assume that 
before observation made, observation has 
an equal probability of being in any cluster 



(4055) For each observation, assume that 
the purposeful probabilities are true 



(4060) For each observation calculate a Bayes 
probability that a particular observation can be 
in each cluster conditional upon the 
observation's proxy value 



(4065) For each 
observation, store and/or 
output the Bayes probability 



(4035) For each observation, 
calculate a ratio of purposeful 
probability to serendipity probability 



(4040) For each observation, calculate a log of 
the ratio to obtain a composition analysis score 



(4045) For each observation, store and/or 
output the composition analysis score 



• min <0.02 



is a value that produces 
meaningful results 



Let N m - total # of observations in 
cluster m\ NJk, e) = the # of 
observations in cluster m who give the 
Sth answer value to variable k; and 



0.02, 



21 



if observation i in cluster m 
"purposefully" and "logically" 
selected his responses, then the 

probabilities of selecting his 
responses should be described by 



Pm(k,e) 



.". Calculate 

Ul,P~tk,z*) 

NB: n means calculate/* for each 
{K...JC} where k-1\ 

£ retains its 
customary function 



(4080) For each observation, calculate a 
percent of proxy values for the variables 
that equals a mode of that observation's 
cluster's proxy values for the 
corresponding variables 



(4085) For each 
observation, output 
the calculated 
percent 



(4090) Classify each observation based on results obtained in 
activity (4045), (4065), and/or (4085) 



Fig. 4 



Method 5 - Segmentation-on-the-Fly 



(5100) Obtain dataset for observations, 
dataset having variables, possible 

values, provided values, and 
corresponding cluster assignments 




For this flow chart, let the total set i 
of variables be defined as {X} and 
the desired maximum # of 
variables to be used as k , , 





(5200) Conditional function: Determine if 
cluster weights are needed to meet 
coverage or efficiency objectives 



\ Underweighting is used to implement 
| efficiency, while overweighting is used to 
I implement coverage 



(5210) If no weights are 
needed, proceed to (5300) 



(5220) Conditional function: 
Assign each cluster a weight 
using the decision rules in 
(5221), (5222), (5223) 



All clusters must be 
assigned weights, 
regardless of magnitude 



(5221) If cluster is to be 
unweighted, set weight 
as w = 1 



(5222) If cluster is to be 
overweighted, set weight 
as w > 1 



(5223) If cluster is to be 
underweighted, set 
weight as 0 < w < 1 



(5300) Begin approximating the clustering solution 
developed using Method 2 by developing clustering 
solutions that employ only 1 variable 
from {K} in each. 



(5310) Create a "dummy" variable for each 
cluster so that if there are M clusters, then K-'J 
M variables 



(5320) Conditional function: populate M variables 
per observation per clustering solution 



j In other words, if there are K variables, Sen k 



I optimized solutions are created, 1 per jt in {K} 



Let Y im designate a 
"dummy" variable for 
observation i in cluster m 

Let f be a member of the set of 
observations {R} % k be a member of 
the set of variables {K} t and m be a 

member of a set of clusters {M} 



(5321) If observation i is in 
cluster m, then Y = 1 



(5322) If observation z is 
not in cluster m, then Y = 0 









(5330) Store all values for M 
variables for all observations 
for each clustering solution 
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Method 5 - Segmentation-on-the-Fly - Continued 




(5340) Create a "dummy" variable for every 
variable-possible value combination so that 
if there are L k possible answers to variable 
Jfc, then L k "dummy" variables are created 
for each observation i for each clustering 
solution 



So the total number of variables 
created per observation per 
cluster is K(LJ 



(5350) Conditional function: for observation / 
and variable k, populate l k variables per 
clustering solution 



(5351) If observation i 
gtves the ^-th answer for 
variable k, then X = 1 



(5352) If observation / 
does not give the t -th 
answer for variable A, 
then X uk - 0 



Let Xifk designate a 
"dummy" variable for 
observation i who can 
answer possible value £ or 
variable k 



(5360) Store alt values lor KfLJ variables 
for all observations per clustenng solution 



(5370) For each cluster in {Mj, use ordinary 

least squares to regress all Y m for all 
observations in {R} per clustering solution 



Index is created by 
multiplying the linear 
approximation to the 

probability of an 
observation's cluster 
assignment by that 
cluster's specified weight 



Regression occurs on: 



[\x m -keK,l<e< Lk -4 



so that we can generate a linear approximation to the 
probability that an observation with a particular set of 
answers to the variables in {K} is in a particular cluster 
within {MJ 



(5380) Conditional function: construct a "simpler" 
clustenng solution to the one generated using 
Method 2 (Bestfit clustering) 



(5381) If weights were specified 
in (5200), create an index for 
each observation's cluster 
association 



By "simpler, what is meant is an 
approximation of the "actual" 
clustering solution using the 

specified constraints, in this case 
using only 1 variable within fKJ 



(5382) If weights were not specified in (5200), assign 
each observation in {R} to the m-th cluster in {M} that 
gives the highest value of the linear approximation to 
the probabilities of being in any of the members of {M} 
as calculated in (5370) for each clustering solution 



(5383) Assign each observation in (Rj to the 
m-th cluster in (Mj that gives the highest 
index value for each clustenng solution 



(5390) Store the outputs of regression (i.e. coefficients and 
constants), vanable IDs, observation IDs, "approximated" cluster 
assignments, and actual cluster assignments for all clustenng 
solutions 



To Fig. 5c 
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Method 5 - Segmentation-on-the-Fly - Continued 



From Fig. 5b 



FROM (5390) 


(5400) Calculate accuracy 
scores for the results 
stored in (5390) for all 
clustering solutions 




Accuracy score = 
[# of observations whose 
approximated and actual 
cluster assignments are 
identical] divided by [the total 
# of observations in /RJ ] 


) ► 








r 



(5410) Select the stored 
solution from (5390) that 
maximizes accuracy score 



± 

(5411) Store the outputs of regression (i.e. coefficients and constants), 
variable IDs, observation IDs, "approximated" cluster assignments, and 
actual cluster assignments for the solution that was selected in (5410) 



(5420) Begin approximating clustering 
solutions using only 2 variables in each 



(5421) Hold variable k from 
(541 1 ) constant and now 
execute (5310) through (5400) 
for all possible pairs of k from 

(5411) and the 
(k + 1 yth variable 



(5422) Refine winning 2 variable solution 
from (5421) 



The pattern in 
(5423) increases 
serially as the 
number of variables 
used to approximate 
the clustering 
solution from 
Method 2 increase 
serially 



(5423) Hold the 
{k + 1 yth variable from (5421 ) constant and now 
execute (5310) through (5411) for all possible pairs 

of the (k + 1 yth variable from (5421) and the 
remaining variables in {K}, excluding the (k + *\yth 
variable and variable k identified in (5411) 



(5430) Continue looping (5420) through (5423) by sequentially 
increasing the number of variables used in (5420) at the beginning of 
each loop until a maximized solution (in terms of accuracy score) is 
identified for a simpler clustering solution that uses k } variables to 
approximate the clustering solution identified in Method 2 



(5440) Select and store the outputs of regression, variable IDs, "approximated" cluster 

assignments (and corresponding observation IDs), actual cluster assignments (and 
corresponding observation IDs), and accuracy scores for only the maximized solutions 
for all solutions created up through and including k. x) variables 



Therefore if the (k + 2)-th 
variable is added to the pair 
of the k-th and (k + l)~th 
variables to create a 
clustering solution that best 
approximates the objective 
function (i.e. original 
clustering structure 
developed in Method 2), then 
in the refining process 

(5422), the 
(k + 2)~th variable is held 
constant while the k-th and (k 

+ l)-th variables are 
replaced with all remaining 
variables to test the triplet of 

variables that best 
approximates the results of 
Method 2 



± 

(5450) Dump (5440) into a file with usable data format 
(e.g. ASCII, .txt, .csv, .pm) 



(5460) Terminate 



Fig. 5c 



Method 6 - Behavioral Segment Scoring 



(6100) For each observation, obtain 
dataset, each dataset having variables, 
possible values, provided values, and 
corresponding cluster assignments 
(developed in Method 2) 



1 


f 


(6200) Transform all continuous variables 
into categorical or scalar forms 


1 


r 



(6300) Conditional function: Refine 
dataset to facilitate analysis 



Dataset can consist of 
any combination of 

scalar, categorical, and 
continuous variables 



Analyze distribution boundaries wTttifn a" 
series of ranges to find the boundaries that 
- create as normal distributions as possible; 
linear optimization is the most efficient 

[ .^f]!!^.?^-^^^. 0 : l h J^ 



1 






r 


(6310) If dataset 

has <= 100 
variables, proceed 
to (6400) 




(6320) If dataset 

has > 100 
variables, reduce 
dataset as much 
as possible 



(6321) Execute the following 
analyses: 

- log scores 

- tree analysis 

- regression 

- discriminant analysis 



(6322) Remove variables 
identified in any 3 of 4 of the 
techniques in (6321) as "non- 

contributorsVinsignificant" 



These are standard 
statistical techniques that 
can be done in a 
mathematical 
programming language 

like Fortran or stat 
software package like 
SPSS or SAS 



Although <= 100 variables 

is ideal (in terms of 
computational efficiency), 
do not force an arbitrary 
"cut-off to ensure < =100 
variables are used in 
the dataset 
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Method 6 - Behavioral Segment Scoring - Continued 



FROM (6310) or (6322) 



(6400) Conditional function: Specify 
maximum # of behavioral variables to be 
used in solution set depending on 
computational and/or time constraints 



(6410) If there is a 
computational or time 

constraint, select a 
maximum # of behavioral 
variables to be used < 

total # of behavioral 
variables in the dataset 



(6420) If there is no 
computational or time 
constraint, make 
maximum # of behavioral 
variables to be used = 
total # of behavioral 
variables in the dataset 



1 




(6500) Conditional ft 
cluster weights ar 
marketing cover 
efficiency 


jnction: Determine if 
e needed to meet 
age or marketing 
objectives 



(6510) If no weights are 
needed, proceed to (6600) 



(6520) Conditional function: 
Assign each cluster a weight 
using the decision rules in 
(6520), (6522), (6523) 



All dusters must be 
assigned weights, 
regardless of magnitude 



(6521) If cluster is to be 
unweighted, set weight 
as w - 1 



(6522) If cluster is to be 
overweighted, set weight 
as w > 1 



(6523) If cluster is to be 
underweighted, set 
weight as 0 < w < 1 



(6600) Execute steps 

(5300) to 
(5450) (of Method 5) 



(6700) Terminate 
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Method 7 - Panel Analysis 



(7100) Conditional function: Ascertain 
use of panel data 



(7110) If use panel data as 
objective measures of 
behaviors to input into 
clustering executed using 
Method 2, follow this path 



(7120) If use panel data for 
post-clustering analyses 
(e.g. tracking, promotion, 

positioning) follow this path 



These 2 paths are not 
exclusive, but cannot be 
executed simultaneously. 
However, path (7110) can 

feed into path (7121). 



(7111) Refine data 
collection instrument (e.g. 
survey) using Invention I 

(i.e. Babbitt Score) 



(7121) Conditional function: 
Data collection 



This is needed to ensure 
that the clustering solution 
developed using this 

dataset is truly 
representative of a 
market/industry and just 

the function of an 
idiosyncratic group of the 
overall population 



Analyze distribution 
j boundaries within a series of \ 
ranges to find the 
boundaries that create as j 
normal distributions as 
I possible; linear optimization 
is the most efficient method 
lorexej^tinathi^ 



(7112) Field data collection 
instrument within panel (e.g. 
IRI, Nielsen, Simmons, 
comSCORE, MRI) 



(7113) Extract observations 
from collected data to 
assemble a dataset that 
reflects a category's/ 
industry's underlying 
demographics 



(7114) Obtain dataset for 
extracted observations, 
dataset having variables, 
possible values, and 
provided values 



(7115) Append panel-based 
behavioral variables to each 
corresponding observation 
in dataset 



(7116) Transform any panel 
variables that are 

continuous into categorical 
or scalar variables 



(7117) Input data set from 
(7116) into (2420) of BestFit 
Clustering and proceed with 
clustering 



(7118) Terminate 



(7121.1) If dataset 
developed using 
path (7110), proceed 
to (7122.1) 



(71 21 .2) Refine data 
collection instrument (e.g. 
survey) using Babbitt Score 



(7122) Execute 
Methods 2 
through 4 



(7123) Execute 
Methods 2 
through 5 



(7123.1) Use typing tool developed in (7123) 
to cluster score a representative sample of the 
panel's members using an expedient contact 
channel (e.g. outbound telephone, e-maii/ 
electronic surveys, mail-based surveys 



(7124) Execute cluster-level 
analyses using panel data 



(7125) Terminate 
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Method 8 - Overall Segment-Based Marketing Process 



(8100) Develop and Field 
Pilot Survey 



(8200) Refine Survey 



Babbitt Score 
Bestfit Clustering 



(8300) Field Full 
Enumeration Survey 



Append panel variables and/or other 
respondent-lvel behaviours (if applicable) 



If applicable 



1 

(8850) Pan 


r 

el Analysis < 






(8900) Develop Segment 
Insights 




r 


(8950) Develop and Execute ^ 
Marketing Ideas * 



(8400) Clean Data 



(8500) Create Clusters 



(8600) Refine Clusters 



(8800) Append Panel 
Variables 



Composition Analysis 



Babbitt Score 

Champion/Challenger Cluster Refinement 
Panel Analysis 



Composition Analysis 



(8700) Segment-on-the-Fly 



(8750) Behavioral Segment 
Scoring 



Fig. 8 



Information Device 9 



(9500) I/O 



(9400) Instructions 



(9300) Memory 



(9200) Processor 



(9100) Network 
Interface 



Method 10 - Fitness Score Calculation 



(10010) Calculate modes of given values for all 




variables in {K} for cluster n 












(10020) Store modes, corresponding 






variable IDs, corresponding cluster ID 










(10030) Calculate modes of given values for all variables 




in {K}tor cluster n+y 





(10040) Store modes, corresponding 
variable IDs, corresponding cluster ID 



(10050) Conditional function: Assess 
the number of clusters for which 
modes have been calculated 



(10060) If the number of 
clusters for which modes 
have been calculated = N, 
proceed to (10080) 



(10070) If the number of 
clusters for which modes 
have been calculated < N, 
return to (10030) 



Where ne{N}e{l} 

N consists of a finite # of clusters > 0. 
I = domain of integers 

Where ke{K}e{l} 

K consists of a finite # of 

variables >0. 
/ = domain of integers 



(10080) For each cluster, compare the 
value provided by each constituent 
member for variable k to the cluster's 
mode for variable k 



Where 



{*}*{!} 



R consists of the set of observations, 
whose total number of 
constituents is > 0. 
_/_= domain^ofjnte^ers 



(10090) Conditional function: compare 
value of L for k to the mode of k 



"\ Where / is a member of cluster n 



(10100) If equal, set 



(10110) If not equal, 



set V. 



k n is the variable k as answered by j 
cluster n 



(10120) Store score V M 



; Where V M = score for observation j 
i who is in cluster n and has provided 
answer value Viox variable k 



(10130) Conditional function: adjust 
V. by indicated weight 



(10140) If weight was 
specfied, multiply V M 
by corresponding 
weight fork 



(10150) If weight was 
not specfied, multiply 



(10160) Store K^from (10140) or 
(10150) 



(10170) Repeat (10080) to (10160) until a 
score V is calculated for all observations in 
their respective clusters for all variables k 



(10200) Sum all scores Kfor all 
observations across all variables 



This is the fitness score \ 



(10300) Store fitness score 



(10400) Terminate 
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